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—If the natural language interface module 222 detects a 
user reque s t (Step 416), i.e. a user request (as determined by 
the PCFG grammar Sygt em and device context) is received, it 
draws one of three conclusions (Steps 420, 422 or 424). 
According to Step 420, the user request is unambiguously 
understood and the natural language interface module can comply 
with a user request. Thus, the natural language interface 
module 222 carries out the command by sending the appropriate 
signals via the device interface 210, as indicated by the device 
abstraction. Then, the context of the speech recognition module 
204 and the natural language interface module 206 is switched 
back to look for attention words (Step 426), before proceeding 
to Step 404.— 

la the Claims: 

Please amend claim 1 as follows: 



^ ^ l.\(Amended> A natural language interface control 

system for operatlh*^ plurality of devices comprising: 
a 3 dimensionaVsmicrophone array; 
& a feature extract lo^roodule coupled to the first 
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^crophone array; 

a speech recognition module coupled to the feature 
extracW modu!e, .herein the speech recognition module 
utilizes Vdden Markov models; 

a hatural language interface module coupled to the 
speech recognition module; and 

a device\jterface coupled to the natural language 
interface module, whe\n the natural language interface module 
±« for operating a plurajW of devices COupled fco fche 

interface based upon non-proved, open-ended natural language 
requests from a user. 



Please amend claim 5 as follows: 



5. (Amended) The system of Claim 1 wherein the 
microphone array comprises said 3 dimensional microphone array 
further comprising a planar microphone array and at least one 
inear microphone array located in a different plane in space. 



please amend claim 6 as followsT| 




(Amended) Th \ system of Claim 1 wherein the 
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nature languaaT^jace abstracts each of the plurality of 
devices into a respectivTW^fa pl UMlity of gImmacs and , 
respective one of . piurality or^e™espo„din s to each of 
the plurality of devices. 




Please amend claim 8 as follows: 




8. (Amended) W system of Claim 1 wherein the 
natural language interface iWe cont9xt switchfis grannnarS/ 
acoustic models, and lexica u P \receipt and recognition of 
attention word. 



an 




Please amend claim 13 as follows: 



13. The system of Claim 1 further comprising a remote 
unit containing a f irst microphone array , ^ 

module", the speech recognition module, and the natural language 
interface module, wherein said 3 dimensional microphone array 
includes the first microphone array. 
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unit includes a second microphone array, wherein said 3 

dimensional microphone array includes the second microphone 

array. 




r plea3e amend clain i 16 as follows (^J 

16. (Amended) The system of Claim 15 wherein the 
first microphone array and the second microphone array implement 
said 3 dimensional microphone array. 

[Please amend claim 17- as follows:^ 

17, (Amended) A method of speech recognition 
comprising: 

searching for an attention word based on a first 
context including a first set of models, grammars, and lexica; 
and 

switching, upon finding the attention word, to a 
second context to search for an open-ended user request, wherein 
second context includes a second set of models, grammars, and 
lexicons. 
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Please insert the following new claims: 




26- (new, A natural language interface control system 
for operating a plurality of devices comprising: 
a first microphone; 

a feature extraction module coupled to the first 
microphone; 

a speech recognition module coupled to the feature 
extraction module; 

a natural language interface module coupled to the 
speech recognition module; 

a device interface coupled to the natural language 
interface module, wherein the natural language interface module 
is for operating a plurality of devices coupled to the device 
interface based upon non-prompted, open-ended natural language 
requests from a user; and 

an external network interface coupled to the natural 
language interface control system. 
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27. (new) The system of Claim 26 further comprising 
the plurality of devices coupled to the natural language 
interface module. 

28. (new) The system of Claim 26 wherein the speech 
recognition module utilizes an N gram grammar. 

29 ■ <n9W) The s y stem ° f Claim 26 wherein the natural 
interface module utilizes a probabilistic context free 

Vyf grammar. 

30. (new) The system of Claim 26 wherein the 
microphone array comprises a 3 dimensional microphone array 
comprising a planar microphone array and at least one linear 
microphone array located in a different plane in space. 

31. (new) The system of Claim 26 wherein the natural 
language interface abstracts each of the plurality of devices 
into a respective one of a plurality of grammars and a 
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respects ona of . piurality of lexica corresponding to each of 
the plurality of devices. 



32. (new) The system of Claim 26 wherein the natural 
language interface module searches for the non-prompted, open- 
ended user requests upon the receipt and recognition of an 

attention word. 




^ language interface module context switches grammars, acoustic 

models, and lexica upon receipt and recognition of an attention 



word. 



34. (new) The system of Claim 26 further comprising a 
grammar module for storing different grammars for each of the 
plurality of devices. 

35. (new) The system of Claim 26 further comprising 
an acoustic model module for storing different acoustic models 
for each of the plurality of devices. 
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36. (new) The system of Claim 26 wherein the device 
interface comprises a wireless device interface. 

37. (new) The system of Claim 26 further comprising a 
remote unit containing the first microphone array, the feature 
extraction module, the speech recognition module, and the 
natural language interface module. 




38. (new) The system of claim 37 further comprising a 
base unit coupled to the remote unit. 

39. (new) The system of claim 36 wherein the base 
unit includes a second microphone array. 



40. (new) The system of Claim 39 wherein the first 
microphone comprises a first microphone array, and said first 
microphone array and the second microphone array implement a 3 
dimensional microphone array. 
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41. (ww) The system of Claim 26 further comprising a 
central database coupled to said external network interface, 
s*id central database including at least one of grammars; Speech 
models; device abstractions; programming information; and 
lexica, 





42. (new) The system of Claim 41 wherein said central 
database is coupled to said external network interface through 

an external network. 

43. (new) The system of Claim 42 further comprising: 
a remote server coupled to said external network and 

to said central database. 

44. (new) The system of Claim 42 further comprising: 

another natural language interface control system; and 

another external network interface coupled to said 

other natural language interface control system, and to said 
external network. 
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45. (new) A natural language interface control system 
for operating a plurality of devices comprising: 

a first microphone; 

a feature extraction, speech recognition and natural 
language interface module coupled to the first microphone; 

a device interface coupled to the feature extraction, 
speech recognition and natural language interface module, 
wherein the feature extraction, speech recognition and natural 
language interface module is for operating at least one device 
X *> the device interface based upon non-prom P ted, open- 

^/)~ ended natural language requests; and 

an external network interface coupled to the natural 
language interface control system. 

46. (new) The system of Claim 45 further comprising a 
central database coupled to said external network interface, 
said central database including at least one of additional 
grammars; additional hidden Markov models; additional device 
abstractions; programming information; and lexica. 
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47. (new) The system of Claim 46 wherein said central 
database is coupled to said external network interface through 
an external network. 

48. (new) The system of claim 47 further comprising: 
a remote server coupled to said external network and 

to said central database. 

49. (new) The system of claim 47 further comprising; 
g\ another natural language interface control system; and 

\}J> another external network interface coupled to said 

other natural language interface control system, and to said 
external network. 




50. (new) A method of making a natural language 
interface control system for operating a plurality of devices 
comprising: 

providing a first microphone; 

coupling a feature extraction, speech recognition and 
natural language interface module to the first microphone; 
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coupling a device interface to the feature extraction, 
speech recognition and natural language interface module, 
wherein the feature extraction, speech recognition and natural 
language interface module is for operating at least one device 
coupled to the device interface based upon non-prompted, open- 
ended natural language requests; and 

coupling an external network interface to the natural 
language interface control system. 

51. (new) The method of Claim 50 further comprising; 
, coupling a central database to said external network 

yfi> interface, said central database including at least one of 

additional grammars; additional hidden Markov models; additional 
device abstractions; programming information; and lexica. 

52. (new) The method of claim 51 further comprising 
coupling said central database to said external network 
interface through an external network. 

53. (new) The method of Claim 52 further comprising; 
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coupling a remote server to said external network and 
to said central database. 

54. (new) The method of Claim 52 further comprising; 
providing another natural language interface control 
system; and 

coupling another external network interface to said 
other natural language interface control system, and to said 
external network. 




55. (new) A natural language interface control method 
/ \ comprising : 

providing a feature extraction, speech recognition and 
natural language interface module- 



coupling the feature extraction, speech recognition 
and natural language interface module to an external network; 



and 



downloading at least one of grammars; speech models; 
device abstractions; programming information; and lexica into 
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the feature extraction, speech recognition and natural language 
interface module through the external network. 

56. (new) A natural language interface control method 
comprising: 

providing a feature extraction, speech recognition and ' 
natural language interface module; 

coupling the feature extraction, speech recognition 
and natural language interface module to an external network; 
and 

transmitting at least one of grammars; speech models; 
device abstractions; programming information; and laxica from 
the feature extraction, speech recognition and natural language 
interface module to the external network. 




Cancel claims through 2fe without prejudice or 

disclaimer. 



REMARKS 
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